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TROPICALLY CONVEX CONSTRAINT SATISFACTION 
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Abstract. A semilinear relation S C Q n is max-closed if it is preserved 
by taking the componentwise maximum. The constraint satisfaction 
problem for max-closed semilinear constraints is at least as hard as 
determining the winner in Mean Payoff Games, a notorious problem of 
open computational complexity. Mean Payoff Games are known to be 
in NP fl co-NP, which is not known for max-closed semilinear constraints. 
Semilinear relations that are max-closed and additionally closed under 
translations have been called tropically convex in the literature. One of 
our main results is a new duality for open tropically convex relations, 
which puts the CSP for tropically convex semilinear constraints in general 
into NP fl co-NP. This extends the corresponding complexity result for 
scheduling under and-or precedence constraints, or equivalently the max- 
atoms problem. To this end, we present a characterization of max-closed 
semilinear relations in terms of syntactically restricted first-order logic, 
and another characterization in terms of a finite set of relations L that 
allow primitive positive definitions of all other relations in the class. We 
also present a subclass of max-closed constraints where the CSP is in 
P; this class generalizes the class of max-closed constraints over finite 
domains, and the feasibility problem for max-closed linear inequalities. 
Finally, we show that the class of max-closed semilinear constraints is 
maximal in the sense that as soon as a single relation that is not max-closed 
is added to L, the CSP becomes NP-hard. 
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i. Introduction 

A relation R C Q n is semilinear if R has a first-order definition in (Q; +, 1); 

equivalently, R is a finite union of finite intersections of (open or closed) 
linear half spaces; see Ferrante and Rackoff pq] . In this article we study the 
computational complexity of constraint satisfaction problems with semilin¬ 
ear constraints. Informally, a constraint satisfaction problem (CSP) is the 
problem of deciding whether a given finite set of constraints has a com¬ 
mon solution. It has been a fruitful approach to study the computational 
complexity of CSPs depending on the type of constraints allowed in the 
input. 

Formally, we fix a set D, a set of relation symbols t = {Ri, R 2 ...}, and a x- 
structure F = (D; R^, R^ ...) where R[ C D ki is a relation over D of arity Iq. 
For finite x the computational problem CSP(F) is defined as follows. 

CSP(r) 

INSTANCE: a finite set of formal variables x-\ .. . x n , and a finite set of 
expressions of the form R(xi, ... x-t k ) with Rex 

QUESTION: is there an assignment x^ ... x^ E D such that (x* ... x* ) e R r 
for all constraints of the form R(x k) ,..., x ik ) in the input? 

When the domain of T is the set of rational numbers Q, and all relations 
of F are semilinear, we say that F is semilinear. We adopt the convention 
that all semilinear relations have rational coefficients. For relations of this 
kind and the questions studied here, whether we work with D = Q or with 
D = R does not play any role. 

It is possible, and sometimes essential, to also define CSP(F) when 
the signature x is infinite. However, in this situation it is important to 
discuss how the symbols from x are represented in the input of the CSP. 
In our context, F is semilinear, it is natural to assume that the relations 
are given as quantifier-free formulas in disjunctive normal form where 
the coefficients are represented in binary (by the mentioned result of 
Ferrante and Rackoff [T 4 I, every relation with a first-order definition over 
(Q; +,<,1) has a definition of this form). However, there are other natural 
representations, and we will for infinite languages always discuss how the 
relations are given. 

A famous example of a computational problem that can be formu¬ 
lated as CSP(T) for a semilinear structure F is the feasibility problem for 
linear programming, which is simply the CSP for the structure F with 
domain Q that contains a relation for every linear inequality, that is, all 

relations of the form {(xi,..., xr) | C] X| c H-P c^Xk ^ Co} for coefficients 

Co, Ci,..., Cic E Q. Here, it is natural to assume that the relations in the 
input are represented via the inequalities that define them, and that the co¬ 
efficients are represented in binary. This CSP is well-known to be in P lE 6 l . 
It follows that the CSP for any semilinear F (represented, say, in dnf) is in 
N P, because we can non-deterministically select a disjunct from the repre¬ 
sentation of each of the given constraints, and then verify in polynomial 
time whether the obtained set of linear inequalities is satisfiable. 
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We would like to systematically study the computational complexity of 
CSP(T) for all semilinear structures F. This is a very ambitious goal. Several 
partial results are known (6} [7}, ;8}]£4}25j- Let us also mention that it is easy 
to find for every structure A with a finite domain a semilinear structure T so 
that CSP(A) and CSP(T) are the same computational problem (in the sense 
that they have the same satisfiable instances). But already the complexity 
classification of CSPs for finite structures is open [13J. 

Even worse, there are concrete semilinear structures whose CSP has an 
open computational complexity. An important example of this type is the 
max-atoms problem M, which is the CSP for the semilinear structure F 
that contains all ternary relations of the form 

M c = {(xi,x 2 ,x 3 ) | X] + c ^ max(x 2 ,x 3 )} 

where c G Q is represented in binary. It is an open problem whether 
the max atoms problem is in P, but it is known to be polynomial-time 
equivalent to determining the winner in mean payoff games (Mohring, 
Skutella, and Stork lE8l l. which is known to be in NP n co-NP. Note that 
here the assumption that c is represented in binary is important: when c is 
represented in unary, or when we drop all but a finite number of relations 
in F, the resulting problem is known to be in P. 

An important tool to study the computational complexity of CSP(F) is 
the concept of primitive positive definability. A primitive positive formula is 
a first-order formula of the form 3 xi,... ,x n (r|>i A ■ ■ • where if) are 

atomic formulas (in primitive positive formulas, no disjunction, negation, 
or universal quantification is allowed). Jeavons, Cohen, and Gyssens f[22j 
showed that the CSP for expansions of Y by finitely many primitive positive 
definable relations is polynomial-time reducible to CSP(F). Let us mention 
that difficult problems in real algebraic geometry are about primitive 
positive definability: the conjecture of Helton and Nie jicjj for instance 
can be phrased as "every convex semialgebraic set has a primitive positive 
definition over the solution spaces of semidefinite programs". 

Primitive positive definability in T can be studied using the polymorphisms 
of F, which are a multi-variate generalization of the endomorphisms of F. 
We say that f: F k —> V is a polymorphism of a x-structure F if 

(f(a],...,a^),...,f(a^,...,f£j) € R r 

for all R G x and (a],..., a^),..., (a’f,..., a£j G R r . For finite structures 
F, a relation R is primitive positive definable in F if and only if R is pre¬ 
served by all polymorphisms of F. And indeed, the tractability conjec¬ 
ture of Bulatov, Jeavons, and Krokhin Biol in a reformulation due to 
Kozik and Barto [I4] states that CSP(T) is in P if and only if F has a 
polymorphism f which is cyclic, this is, has arity n ^ 2 and satisfies 
Vxi,... ,x n f(xi,...,x n ) = f(x 2 ,...,x n ,xi). 

Polymorphisms are also relevant when F is infinite. For example, a 
semilinear relation is convex if and only if it has the cyclic polymorphism 
(x,y) i-a (x + y)/ 2 . The CSP for such relations is the feasibility problem 
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for strict and non-strict linear inequalities, and it is well-known that this 
problem is in P. When F has a cyclic polymorphism, and assuming the 
tractability conjecture, V cannot interpret primitively positively any hard 
finite-domain CSP, which is the standard way of proving that a CSP is 
NP-hard. 

A fundamental cyclic operation is the maximum operation, given by 
(x,y) max ( x, lj j . The constraints for the max-atoms problem are exam¬ 
ples of semilinear relations that are not convex, but that have max as a 
polymorphism; we also say that they are max-closed. When a finite structure 
is max-closed, with respect to some ordering of the domain, then the CSP 
for this structure is known to be in P [l2ifl . The complexity of the CSP 
for max-closed semilinear constraints, on the other hand, is open. Since 
this problem is more general than the max atoms problem, it is at least 
as hard as determining the winner of mean payoff games. But unlike 
the max-atoms problem, it is not known whether the CSP for max-closed 
semilinear constraints is in co-NP. 

2. Results 

We show that the CSP for semilinear max-closed relations that are translation- 
invariant, that is, have the polymorphism xiax + c for all c G Q, is in 
NP n co-NP (Section [5]). Such relations have been called tropically convex in 
the literature This class is a non trivial extension of the max-atoms 
problem (for instance it contains relations such as x ^ Cy +z)/2), and it 
is not covered by the known reduction to mean payoff games H28I [xj [3J. 
Indeed, it is open whether the CSP for tropically convex semilinear relations 
can be reduced to mean payoff games (in fact, Zwick and Paterson M 
believe that mean payoff games are "strictly easier" than simple stochastic 
games, which reduce to our problem via the results presented in Section [4). 
The containment in NP n co-NP can be slightly extended to the CSP for 
the structure that includes additionally all relations x = c for cgQ (rep¬ 
resented in binary). It follows from our results (Corollary [3^5]) that the 
class of semilinear tropically convex sets is the smallest class of semilin¬ 
ear sets that has the same polymorphisms as the max atoms constraints 
x ^ max(y,z) + c with c E Q. 

In our proof, we first present a characterization of max-closed semilinear 
relations in terms of syntactically restricted first-order logic (Section [3]). We 
show that a semilinear relation is max-closed if and only if it can be defined 
by a semilinear Horn formula, which we define as a finite conjunction of 
semilinear Horn clauses, this is, finite disjunctions of the form 

m 

V c i 

i=1 

1 Interpretations in the sense of model theory; we refer to Hodges K20I since we do not need 
this concept further. 

2 The original definition of tropical convexity is for the dual situation, considering min 
instead of max. 
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where 

(1) ai ... a m G Q n and there is a k ^ n such that ay, ^ 0 for all i and 

) ~f~ k / 

(2) x = (xi ... x n ) is a vector of variables, 

(3) >-t 6 {>, >} are strict or non-strict inequalities, and 

(4) ci ...c m £ Q are coefficients. 


Example 2.1. The ternary relation M c from the max-atoms problem can be 
defined by the semilinear Horn clause X2 — xi >cVx 3 — xi ^ c. 

Example 2.2. A linear inequality aixi + • • • + a n x n ^ c is max-closed if 
and only if at most one of ai ... a n is negative. The relations defined by 
such formulas are in general not tropically convex; consider for example 
the relation defined by —xi + X2 + X3 ^ 0. 


Example 2.3. Conjunctions of implications of the form 

(1) X; ^ Ci A • • • Ax n ^ c n =>■ xi < Co 

are max-closed since such an implication is equivalent to the semilinear 
Horn clause 

(-Xi > -Co) v\jx i > Ci . 


It has been shown by Jeavons and Cooper |2T| that over finite ordered 
domains, a relation is max-closec0 if and only if it can be defined by finite 
conjunctions of implications of the form ([1]). Over infinite domains, this 
is no longer true, as demonstrated by the relations in Example 
Example |2.2| 


2.1 


and 


We also show that the classes G of max-closed semilinear relations and C t 
of tropically convex semilinear relations are finitely related in the sense of 
universal algebra, this is, there exists a finite subset fo of G (resp. F t of S t ) 
that can primitively positively define all other relations in G (resp. C t ). For 
instance, we show that all relations in G have a primitive positive definition 
in 


Fo = (Q;<, 1,— 1,S-|,S2,M 0 ) 

where 

Si = {(x,y) | 2x ^ -y} S 2 = {(x,y,z) | x ^ y + z} 

Mo = {(x,y,z) | x ^ ij V x ^ z} 

Note that any other structure Fi with finite relational signature and this 
property has a polynomial-time equivalent CSP. We show that the primitive 
positive formulas can even be computed efficiently from a given semilinear 
Horn formula 4 >, and have linear size in the representation size of ([). 

Our proof of the containment in NP n CO-NP is based on a duality for 
open tropically convex semilinear sets, which extends a duality that has 

3 Also the results in Jeavons and Cooper I21I have been formulated in the dual situation for 
min instead of max. 
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Figure i. An overview of constraint languages relevant 
for this work (P membership for finite domain max-closed 
CSPs is in lUill . NPnco-NP membership of max-atoms is 

in 0). 


been observed for the max-atoms problem in (i8| . To prove the duality, we 
translate instances of our problem into a condition on associated mean pay¬ 
off stochastic games (also called limiting average payoff stochastic games; 
see [ 15] for a general reference), and then exploit the symmetry implicit in 
the definition of such games. The connections between the max-atoms prob¬ 
lem, mean payoff deterministic games, and tropical polytopes have been 
explored extensively in the computer science literature. However, the the¬ 
ory of stochastic games introduces profound changes over the deterministic 
setting, and employs non-trivial new techniques. Even though this field 
is active since the 70s, to the best of our knowledge, no application of its 
results to semilinear feasibility problems has been published yet. Note that 
to solve mean payoff stochastic games is in NP n CO-NP, as a consequence 
of the existence of optimal positional strategies; see [T7J and [27] (for a 
general reference on the computational complexity of stochastic games, see 
lEl). However, we cannot use this fact directly, because stochastic games 
only relate to a subset of tropically convex sets. We conclude our argument 
combining the duality with semilinear geometry techniques. 

Interestingly, at several places in our proofs, we need to replace Q with 
appropriate non-Archimedean structures, for instance in the proof of the 
syntactic characterization of max-closed semi-linear relations, in order to 
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deduce the general case from the easier situation for closed semilinear 
relations. But also for representing the winning strategies for stochastic 
games, and for using the duality for closed tropically convex relations 
to solve the CSP for tropically convex constraints, we work with explicit 
non-standard models (for another application of non-standard models to 
CSPs see for instance 03). 

Our next result is the identification of a class of max-closed semilinear 
relations whose CSP can be solved in polynomial time (Section [6]). This 
class consists of the semilinear relations that can be defined by restricted 
semilinear Horn formulas, which are conjunctions of semilinear Horn clauses 
satisfying the additional condition that there are k ^ n and l ^ m such that 
(at) j ^ 0 for alii £ (1 ,..., m} \ {1} and j £ ( 1 ,... ,u} \ {k}. An example of a 
semilinear Horn clause which is not restricted Horn is xi < x 2 V x-\ <x$. 

Finally, we show that the class of max-closed semilinear constraints is 
maximal in the sense that for every relation R that is not max-closed, the 
problem CSP(Fo,R) is NP-hard (Section]^]). Figure [l] gives an overview over 
our results. Of course, all our results apply dually to min-closed semilinear 
relations as well. 

3 . A Syntactic Characterization of Max-closure 

This section aims to offer a syntactic characterization of semilinear max- 
closed and semilinear tropically convex relations over Q. In this section, 
the letter F will denote an ordered field: for technical reasons we need to 
work in this slightly more general setting. 

Definition 3 . 1 . A semilinear Horn clause is called closed if all inequalities 
are non-strict. We say that X c F n is a basic max-closed set if it is the graph 
of a semilinear Horn clause, i.e. there is k £ (1 .. .n) such that X can be 
written as a finite union 

X = U {( Xl • • - Xn ) I ai '1 X l _4 -^ a vnXn >~i Ci} 

i 

where can be either > or and ay ^ 0 for all i and all j f k. We say 
that X is basic closed max-closed if it is the graph of a closed semilinear Horn 
clause. 

Theorem 3 . 2 . ( 1 ) Let X C F n be a semilinear set. Then X is max-closed if 

and only if it is a finite intersection of basic max-closed sets. 

( 2 ) Let X C F n be a closed semilinear set. Then X is max-closed if and 
only if it is a finite intersection of basic closed max-closed sets. 

( 3 ) X c Q Tl is primitive positive definable in To = (Q;<, 1, — 1,Si,S 2 , Mo) 
with 

Si = {(x, y) | 2 x ^ y} S 2 = {(x,y,z) | x ^ y + z} 

M 0 = {(x,y,z) | x ^ y Vx ^ z} 

if and only if X is semilinear and max-closed. 

( 4 ) x C is primitive positive definable in Tq = (Q; 1, —1, Si, S 2 , Mo) if 
and only if X is semilinear closed and max-closed. 
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Definition 3.3. We say that X c F n is a basic tropically convex set if there 
is k £ {1 ... n} such that X can be written as a finite union 

X = |^J | (x l ... X n ) | ay 1 X1 + • • • + d| /Tl X n >— | C| I 


where can be either > or and ay ^ 0 for all i and all j f k, and, 
moreover 


Y a L> = 0 


for all i. 


Theorem 3.4. (1) Let X C P be a semilinear set. Then X is tropically 

convex if and only if it is a finite intersection of basic tropically convex 
sets. 

(2) X C Q n is primitive positive definable in F L = (Q; <,Ti,T_-j ,S3, Mo) 
where 


T±i = {(x, y) | x ^ y ± 1 } S 3 



x ^ 




if and only if X is semilinear and tropically convex. 


Corollary 3.5. A semilinear set X C Q n is tropically convex if and only 
if it is preserved by every polymorphism that preserves the max-atoms 
language (i.e. all sets of the form {(x,y,z) | x ^ max(y,z) + c} for c £ Q). 

Proof. Translations and maximum are polymorphisms of max-atoms, so 
one direction is trivial. For the converse, by Theorem |3.4[ )2), it suffices 
to prove that the relations <, T|, T_i, S 3 , and Mo are preserved by all 
polymorphisms of max-atoms. This is immediate for T|, T_i, and Mq since 
they have primitive positive definitions over max-atoms. The relation <, on 
the other hand, is an monotone union of max-atoms constraints 

< = {(x,y) | x<y}= [J {(x, y) | x^y-c} 

CGQ,C>0 

and S 3 is an intersection of max-atoms constraints 
S3 = | (x,y,z) | x <= ^ 2 Z > = P| {(x,y,z) | z ^ max(y + c,z-c)} 

It's well known that monotone unions and arbitrary intersections of primi¬ 
tive positive definable sets are preserved by polymorphisms [[29J. □ □ 

The following observation is important in view of its implications on the 
complexity of the constraint satisfaction problems for max-closed and tropi¬ 
cally convex sets. The reader will recognize that it follows straightforwardly 
from the proofs of Theorem |3-2| and Theorem |3-4| 

Observation 3.6. Given a max-closed (resp. tropically convex) set X written 
as a finite intersection of basic max-closed (resp. basic tropically convex) sets 
with the constants represented in binary, we can compute in polynomial 
time a primitive positive definition of X in the structure Fq (resp. F t ). 
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In this section, as well as in Section [5J we will make use of a few 
basic facts about semilinear geometry. Semilinear sets, as defined in the 
introduction, are finite Boolean combinations of half spaces in Q n . We 
already mentioned that this setting can be extended without difficulty to 
an ordered field F. An example of ordered field that we will need is the 
field of formal Laurent series F((e)), whose elements are the series of the 
form 

OO 

Y die 1 

i=—OO 


where e is a formal variable, the coefficients at are in F, and the set of 
integers i such that at / 0 is bounded from below. The field F((e)) can be 
seen as the field of fractions of the ring of formal power series F[[e]], whose 
elements are 


L 

i=0 


me 


On both these structures, we give the lexicographic order with e 1 -C e> 
for i > j, the choice of e as the name of the formal variable is indeed meant 
to be a reminder of this. The open convex semilinear subsets of F n are 
precisely the finite intersections of open half spaces (see lim Corollary 4.9] 
and also I30]). 

Still further, one can consider finite Boolean combinations of half spaces 
in V TV , where V is an ordered F-vector space. By a half space in V n here we 
mean a set defined by (x G V n ci T x >- c}, where a G F n and c G V. From 
this point of view, one can prove that the semilinear sets are precisely 
those first order definable in the structure Fy = (V; <, +, <x- ) ae f, where 
a- represents the function mapping x G V to ax. Now, Fy is a so called 
o-minimal structure, see [31] as a general reference, and, as all o-minimal 
structures expanding an ordered group, it has definable Skolem functions 
(definable choice). Namely, given a parametric existential formula 3 xc[)fx, p ) 
which is true for all p G V n , there is a semilinear function x = x(p) such 
that 4 )(x(p),p) holds for all p G V n . We will make extensive use of this 
principle. 


We begin with the proof of Theorem 3.2 It is convenient to prove the 

to 


four points in the order (2)-(i)-(3)-(4). Then we will use Theorem 3.2 


deduce Theorem 3.4 


Claim 3.7. Let X C F n be an open semilinear set, then X is a finite union of 
convex open semilinear sets. 


Proof. A semilinear set Y c F 71 is said to be relatively open if Y is open in the 
affine subspace of F n generated by Y. All semilinear sets are finite unions 
of relatively open convex semilinear sets (e.g. I31] . Chapter 1 Corollary 7.8]). 
It therefore suffices to show that given a relatively open convex semilinear 
Y C X, there is an open convex semilinear set Z such that Y C Z C X. Let A 
be the affine space generated by Y. Then Y can be written in the form 

Y = {x G A | f 1 (x) > 0 A ■ ■ ■ A f p (x) > 0 } 
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for some affine fi ... fp. Without loss of generality, we may assume that 
the projection of A onto the first d = dim(A) coordinates is one-to-one. 
Consider the function 6: F >0 —> W° U{+oo} mapping e to the largest 6(e) 
such that for all x G Y we have 

fi(x) ^ e A- ■ • Afp(x) ^ e =F x + B 6(e) cX 

where 

B« = {y G F n | yi = • • • =y d = 0 Ay d+1 ...y n G ( - a,a)} 

First we claim that 6(e) is well defined and positive for all e > 0 . Well 
definedness is immediate. Suppose that for some e we have 6(e) = 0 . This 
means that for all 6' > 0 we can find anx'(6') G Y such that 

f 1 (x'(6')) ^ eA---Af p (x'(6')) ^ e A x'(5') + B 6 , £X 

By definable choice we can assume that the function 6' 4x'(6') is semilin- 
ear. Consider the limit 

x" = lim x / (6 / ) 

6 '—> 0 + 

Clearly, for all 6 " > 0 

fi (x /; ) ^ e A- • ■ Afp(x // ) ^ e A x"+ P>b" 

contradicting the fact that X is open. Now, e i-t 6(e) is first-order definable 
from semilinear data, hence it is semilinear, and we know that it must be 
increasing and map positive elements to positive elements. It follows that 
6(e) ^ amin(e,b) for some positive a and b. Fience 

^ [_J * A B a m j n (e,t>) A X 

xeY 

It is easy to check that Z is open and convex. □ 

Definition 3.8. We say that x E X c F n is of type k in X, with k E (1 ... n}, if 
X- Qk ={x-y | y G Qk} C X where 

Qk = {y e (F^°) n | y k = 0} 

Observe that if X is the complement of a max-closed set, then every point 
of X is of type k in X for at least one k. Figure [2] displays an example of 
semilinear max-closed set, with points of its complement marked according 
to their type (notice that max-closed sets need to be neither convex nor 
connected). 

Claim 3.9. Let X be an open semilinear subset of FA Then the set X k of all 
points of type k in X is an open semilinear set. 

Proof. The set X| c is clearly semilinear, hence all we need to prove is that 
it is open. Pick x on the boundary of X^, it suffices to prove that x f X k . 
Since x is on the boundary 

Ve > 0 36 (e) G F n 15 ( 6 ) 1 *, < e A 6(e)+x^X k 
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Figure 2. A max-closed set in Q 2 


where | • 1^ denotes the maximum norm, and expanding the definition 
of X k 

Ve > 0 35 (e) G F n 16 (e)!*, < e A 3 y(e) G Q k 6(e)+x-y(e) ^ X 

Now, by definable choice, we can assume that the function e 1 —> y(e) is 
semilinear. Hence the limit 


y 0 = lim y(e) 

e—>0+ 

exists. Since Q k is closed, we have yo <G Q k , and, since X is open, we have 
x —yo ^ X, therefore x ^ X k . □ 


Proof of Theorem |3 .jz | (2). The if part is immediate, hence we concentrate on 
the only if. Let X be F n \ X. Consider the subsets Xi ... X n of the points 
in X of type 1 ... n respectively. Since X is max-closed, each point of X is of 
type k for some k e {1 ... n}, hence 

X = X! U-UX n 


moreover, by Claim 3.9 each of these sets is open and semilinear. Applying 
Claim 3.7 we can further split each of the sets Xt into a finite union 

X t — Xn U • • • U X| m . 


of convex open semilinear sets. Now, by definition, Xt = Xt — Qt, hence 

Xi = X kl U • • • U X| /rrli 

where Xy = X k j — Qt. We claim that each of the sets Xyj = F n \ X L; j is 
definable by a semilinear Horn clause: this is enough to conclude because, 
by what was said, X is the finite intersection 

X = f| X « 

Lj 
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It is easy to check that the sets Xy are open and convex. Therefore each of 
them is a finite intersection 

Xy = (~'| {(Xi • • •X-n) | ayjyXi + ' ' ' + ayynXn Cy,k} 

k 

in other words 

Xy = (^J {(X! . . .X n ) | ay + • • • + Qy^nXn ^ Ci,j,k} 
k 

It remains to check the condition on the coefficients ayjy, namely we claim 
that ayyi ^ 0 f° r ah l / i. For a contradiction, suppose that ay,1c,; < 0 
with l 7^ i. Then pick a point (xi ... x n ) e Xy. Then 

(XI ...Xn)-(O...N...O) ^Xy 

for N larger than 

/ ayjy XI + • • • + ayynXn 

—ay,k,i 

contradicting the construction of Xy. □ 

Proof of Theorem I3T2]— (2)^(1). Our strategy is the following. We apply (2) 
to the field of formal Laurent series F((e)) with coefficients in F. Each 
semilinear set XcP has a unique extension X* to F((e)) n , which is the 
set defined by the same formula that defines X (clearly which one is chosen 
is immaterial). Let X denote our max-closed set, which is not necessarily 
closed. The extension X* of X is closed if and only if X is, however we will 
modify X* slightly to obtain a closed semilinear max-closed set X C F((e)) n 
such that X n F n = X. Our intention is to apply (2) to X, and write it as 
an intersection of basic max-closed sets. This and the relation X n F n = X 
are not prima facie sufficient to recover a similar expression for X, because 
the coefficients appearing in the definition of X are, in general, elements 
of F((e)). Nevertheless we will be able to reduce to the case of coefficients 
in F by a sequence of formal manipulations. 

The first step is the definition of X. The only properties that we require 
are that X must be closed max-closed semilinear and that X n F n = X. To 
this aim, write X as a finite union 

X = Xi u • ■ ■ u x m 

of relatively open semilinear sets. Call Hi the affine subspace generated 
by Xt for i € (1 ... m}, so by definition Xi is open in Hi. Now define 

x i = {peH? | B e (p)nH* ex*} 

where B e (p) denotes the ball of radius e centered at p in the sup distance, 
and the overline denotes the topological closure. Clearly Xi C Xi C X-, 
where the first inclusion follows from X t being relatively open. Hence the 
following set 


X = max-closure (Xi U • • • U Xk) 
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meets our requirements (where max-closure denotes the closure under the 
maximum operation). 

By (2), we can write X as an intersection of basic closed max-closed 
subsets of F((e)) n . So it suffices to prove that given a basic closed max- 
closed B C F((e)) n , then B' = B n F n is an intersection of basic max-closed 
subsets of F n . Let B' be 

B' = {(x-i ...x n ) <E F n | cox! 3 -F Q n x n ^ c} 

with ai ... a n/ c £ F((e)) satisfying the condition cu ^ 0 for i / kg. We will 
prove that B ' is a finite positive Boolean combination of sets of the form 

{(xi ...x n ) £ F n | a)xi H-ha^Xn >- c'} 

with a) ... a' w c' 6 F all satisfying a( ^ 0 for i 7^ k B . From this follows our 
assertion. 

Multiplying the equation 

a-]Xi -I-1- a n x n ^ c 

by a suitable power of e we can assume that all the coefficients at are 
in F[[e]]. We will proceed by induction on the number of the coefficients at 
which are not in F. If this number is 0 , the only problem is that c may not be 
in F. Either c has infinite magnitude (i.e., the leading monomial has negative 
degree), or it is of the form c = Co + ec>o with Co G F and c>o £ F[[e]]. In 
the first case, B ' can only be all of F n or the empty set. In the second case, 
B' is 

B' = {(xi ...x n ) £ F n | aixi H- F a n x n F- c 0 } 

where F- is ^ if c>o ^ 0 , and ^ is > if c>o > 0 . 

Assume that the cardinality of the set I = {i | cl l 0 F} is a positive num¬ 
ber m. Write a L = (cq) 0 + efa i )> 0 with (aJo £ F. As before, if c has infi¬ 
nite magnitude, then B' is trivial, hence we can also write c = Co + ec>o- 
Then x £ F n is an element of B ' if and only if 

(a] ) 0 xi -t-F (a n )oXn ^ c 0 

A 

( (ai)oxH-F (a n )ox n > c 0 V (a 1 ) >0 x 1 H- F (a n ) >0 x n ^ c> 0 ) 

The first and the second conditions in this expression are immediately of 
the required form. The third condition is relevant only when 

(ai)oM H- F (a n ) 0 x n = c 0 

because if < holds then x ^ B' by the first condition, and if > holds 
then x £ B' by the second condition. We will bring this condition in 
an equivalent form with less than m coefficients which are not in F. 

Let h be such that |(a> x )>ol is maximal, clearly h £ I. Dividing 

( a l )>0 X 1 + • • • + (a n )>O x n ^ c >0 

by |(ah)>ol w e obtain an equivalent condition such that the coefficient of xh 
is ±1 £ F. However, in order to apply the inductive hypothesis, we also 
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need to ensure that all the coefficients except that of X| c are non negative. 
This can be achieved by adding a suitable multiple of 

(ai) 0 xi H-h (a n ) 0 x n = c 0 


to obtain 


/ (o-i )>o 
\K a h)>0 


+ N • (ai)o 


X] 4 -h 


( (ln)>0 

\l( a h)>ol 


+ N • (dn)o 


Xtl 


C>0 

l( a h.)>ol 


+ N • Co 


in fact, (ai)>o can be negative only if (cy)o is positive. 


□ 


Proof of Theorem \3 -2\ (?,)-(4). Clearly the relations in our finite basis are semi- 
linear, closed, and max-closed, hence the only if of (3) is immediate. Topo¬ 
logical closure is preserved by finite intersections. Therefore, to estab¬ 
lish the only-if part for (4), we only have to check that projections of 
semilinear closed sets are closed. For a contradiction, pick a point xo 
in the boundary of 7t(X), then for all e > 0 there is a x(e) E X such that 
|7t(x(e)) — x^ < e. As usual, by definable choice, we can assume that 
the function e 1—x(e) is semilinear, and taking the limit for e —> 0 we get 
an x E X such that 7t(x) = xo- 

For the if part, first we prove (4). By (2), it suffices to show that basic 
closed max-closed sets are primitive positive definable using our relations. 
Consider the set 


X — { (Xl . . . X n ) | Clyl Xi + • • • + Ui,n.Xn ^ CiJ 

i 

with Q[ ; j ^ 0 for all i and all j f k. We can write equivalently X = U"-i Xi 
where X t denotes the set defined by the formula 

| 3 iX k ^ Y_ a M x i _c i 
) 

and the coefficients ( 3 t, cqj, and Ct are chosen in such a way that they are 
all integers with ( 3 i > 0 and 04.4 ^ 0. 

First we prove that Xi is primitive positive definable using { 1 , — 1 , Si, S2}. 
To this aim, it suffices to show primitive positive definitions of the sets de¬ 
fined by 2 m x ^ y and y ^ z\ + • ■ • + zn for any M and N. In fact, intersect¬ 
ing them and projecting along y one obtains the set 2 M x C zi + ■ ■ • + zn, 
and assigning xi ... x n or ±1 to the variables x and zi ... zn it is easy to 
obtain Xt- The set 2 M x ^ y is defined inductively on M by 

2 M+1 ^y 3 t 2 x^tA 2 M t^y 


And the set y ^ z\ -I-h zn is defined inductively on N by 

y ^ zH- Kzn +1 3ty ^ t + ZN+i At ^ zi-I- Hzn 

Now we show that the union of the sets Xt is primitive positive definable. 
First we replace the variable x k on the left hand side in the definition of 
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each of these sets (remember that k is fixed) with a new variable x(. Thus 
we end up with the following sets 

(X|, X"| . • • Nx) £ Ar- PiX| ^ ) <Xi,jXj Ci 

j 

remember that we assumed, without loss of generality, that all coeffi¬ 
cients | 3 i are strictly positive. We can combine the sets X( to form a new 
definition of X 


(xi .. .x n ) E X 3 x) . 


(x,,xi ...x n ) E X^ 

A 

• • x m < ( x my ^1 • • • 

A 

v x k ^ x) V - • • Vx k ^ 


Now it remains to show a primitive positive definition of the last clause 

x k ^ x) V • • • V x k ^ x^ 


We can proceed by induction on m observing that it is equivalent to 

3 t (x k ^ t Vx k ^ x(J A (t ^ x| V • ■ ■ V t < x^.-i) 

The if part of (3) is analogous, using (1) in place of (2), and observing 
that the relations x < y V x ^ z and x < y V x < z are primitive positive 
definable. □ 


Proof of Theorem [34] We will concentrate on point (1). Point (2) is analogous 
to Theorem |3 . 2| (3)-(4). Denote by T k : Q n -A Q n the translation by k E Q 
applied componentwise 

T k : (xi ... x n ) 1 —y (xi + k... x n + k) 


Applying Theorem 3.2 we can write X as an intersection of basic max- 
closed sets X L . Let X{ denote the set 


x( = n 

keQ 


Since X is translation invariant, for all i, we have X C X' C Xt, hence X is 
the intersection of the sets X(. The sets X( are clearly translation invariant, 
therefore we only need to prove that each of them is an intersection of basic 
tropically convex sets. In other words, given a basic max-closed set B, we 
want to prove that 

b'= n T k (B) 

keQ 

is a finite intersection of basic tropically convex sets. Let B be 


B = |J { (^1 •■•A) I cqyX! 3-ha j;Tl x n Ej Cj} 

j 

with ajj ^ 0 for all l f kg. It suffices to write B' as a positive Boolean 
combination of sets of the form 


{(xi . ..Xn) | a-jXl 3-ha( n Xn y- Cj} 
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with Y i a | l = 0 and a- 1 ^ 0 for all l / kg. By definition we have 

B' = P| |J {(X! ...Xn) | ClyiXl -I-1- aj /n x n -ksj yj Cj} 

keQ j 

where Sj = Y i a j,i- We can separate the indices j satisfying Sj = 0 writing 
B' = Bq U B^ 0 where 

Bq = |^J | (xi . . . X n ) | CLjJ XI + • • • + Qj /Tl X n yj Cj j- 

j|S)=0 

B^o= fl U {( x i •••Xn) I djjX] H-h a j/Tl x n - ksj Cj} 

keQils^o 

Now, Bq is already in the required form. Rearranging the definition of 
we get 

x E B_^ 0 Q = |^J {k E Q | cijqxi + • ■ ■ + Uj /n x n Cj y^ ksj } 
jkj^O 

On the right hand side, we have a union of left and right (according to the 
sign of Sj) half lines. This union covers all of Q if and only if it contains 
two opposite overlapping half lines. Hence 

B^o = (J < (xi ...X n ) [ Y (aj,iSl-ai,iSj)Xi Aj,l CjSt-CiSj 

j,l|Sj<0Asi>0 v i=l 

where Aj,i is > if Ej and Ai are both >, and it is ^ otherwise. □ 


4 . A Duality for Max-plus-average Inequalities 

Let O n be the class of functions mapping (QU{+oo}) n to QU{+oo} of 
either of the following forms 


(xi ...x n ) H-max(xj, +k 7 ... x jm + k m ) 

(xi ...Xn)H minfxj, +ki ...Xj m +k m ) 


(xi ...Xn)H 


mxj, + • • • + a m Xj m | k 

«li-ha m 


where k,kt E Q and a L E Q >0 . 

For any given vector o E 0 of n operators in O n , we consider the 
following satisfiability problems: the primal P(o) and the dual D(o) 


P(o): 


x E Q n 
x < o(x) 


D(o): 


y E (Q U{+oo}) n \{+oo} n 

y > o(y) 


where < and ^ are meant to hold component-wise. We intend to prove the 
following result. 


Theorem 4.1. For any o E 0 one and only one of the problems P(o) 
and D(o) is satisfiable. 
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For the proof of Theorem 4.1 we will make use of zero-sum stochastic 
games with perfect information, in the flavours known as the discounted 
and the limiting average payoff. In this context, it is more natural to work 
over the domain ]R of the real numbers instead of Q. Observing that the 
satisfiability of P(o) and D(o) is insensitive to the domain, for the rest of 
this section, we will work with the real numbers. 

The set-up for a stochastic game is a directed graph G with vertex- 
and edge-labels, all vertices of G must have at least one out-edge. Each 
vertex of G is either assigned to one of the players, in this case it is labelled 
with one of the symbols max and min, or it is a stochastic vertex, and in this 
case it carries the label s. Each edge e of G has a label po(e) G 1 R, which 
represents the payoff earned by max (or the penalty incurred by min) 
when that edge is traversed. The out-edges of a stochastic vertex have 
an additional label pr(e), which is a rational number representing the 
probability that each edge is taken when exiting that specific vertex: clearly, 
the probabilities of the out-edges of each stochastic vertex must sum to 1. 

A stochastic game G is played by moving a token along the directed 
edges of G. First the token is placed on a vertex which we call the initial 
position. Then, repeatedly, the token is moved by max when it is on a 
m Ax-vertex, by min when it is on a MiN-vertex, and at random when it is 
on an s-vertex (according to the probabilities assigned to the out-edges of 
that vertex). A play never ends. 

Let e-|, e2 ... be the edges traversed during a play p on G. The discounted 
payoff v p (p) of p with discounting factor |3 G [ 0,1 [ is 


vp(p) = (1 - ft) Y po(et)|3 


i—1 


i=1 


and the limiting average payoff is 


vi(p) = lim inf — po(eQ 

T —>00 I z — 


i=1 


In such formulas we suppress the dependency on G, to ease the notation. 

In general, a strategy for player P G {max, min) is a probability distribu¬ 
tion on the functions mapping every partial play Vo Vi ... ^ vj ending 
in a P-vertex vy to one of the out-edges of v-p such functions are called 
pure strategies. Playing according to a strategy n means to choose one of the 
pure strategies f at random with the probability distribution 7t, and then 
choosing one's moves by calling f. Given two strategies 7t MAX and 7t MIN 
for the two players, one can thus define the value Vp (v,7T max , 7T min ) as the 
expected Vp of a play generated by the given pair of strategies from the 
initial position vo = v. 

For a given game G and (3 G [ 0 , 1 ], a strategy 7t MAX for max is optimal if 
for all vertices v it maximizes the quantity 


V (3 (V, ^MAX/ 


— inf Vp (v, 7t MAX , 7t MIN ) 

T^MIN 
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Conversely a strategy 7t MIN for min is optimal if it minimizes 
"V|3 ( v / '/ ^min) = Slip Vp (v, 7T max / Amin) 

TTmax 

Given a stochastic game G and a |3 G [ 0 , 1 ], there are optimal strategies for 
each player, moreover, calling 7 t MAX and 7 t MIN two optimal strategies 


v p (c TGiAX/ ■ ] — v p (v, ', 7 t MIN ) 


holds for any initial position v. This value does not depend on the 
pair of optimal strategies chosen, but only on (3 and the initial posi¬ 
tion v (and G), hence we may denote it by the notation vp(v). The vec¬ 
tor vp = (vp (v)) ve v(G) is called value vector of G with discount factor | 3 . 

In the specific case of perfect information stochastic games, one can show 
that there are optimal strategies which are also pure and stationary (also 
known as memoryless or positional). In other words there are optimal strate¬ 
gies that prescribe for each possible position of the token (i.e. each max- or 
MiN-vertex) one definite next move. If we further restrict our consideration 
to the discounted payoff criterion (i.e. (3 < 1 ), then the value vector of a 
game G admits an explicit description through a condition known as the 
limit discount equation (see m Theorem 4.3.2 and also Definition 4.3.12) 


vp(v) = < 


max( v/W ) £ e(G) H — | 3 )po(v,w) + ( 3 vp(w) if v is a MAX-vertex 
min (V/W)eE(G) (l - ( 3 )po(v,w) + ( 3 v p (w) if v is a MiN-vertex 
L(v,w)eE(G) pr(v,w )((1 - | 3 )po(v,w) + | 3 vp(w)) 

if v is a stochastic vertex 


In particular we will need the following fact (see [15I Theorem 6.3.7 plus 
Theorem 6.3.5 an d its proof). 


Fact 4.2. For any stochastic game G with perfect information 

(1) both players possess pure stationary strategies 7 t MAX and 7 t MIN which 
are optimal for the limiting average payoff and for all discount factors (3 
sufficiently close to 1 

(2) calling vp the value vector of G with discount factor ( 3 , the value vector 
for the limiting average payoff can be written as Vi = limp^i Vp 

(3) the solution Vp to the limit discount equation can be written as a power 
series in (1 — ( 3 )—more precisely, consider the field R((x)) of formal 
Laurent series in x ordered by 0 < x <C 1 , let (3 = 1 — x G R((x)), then 
the limit discount equation for Vp has a formal solution in R((x)) n 
which, moreover, is convergent in a neighbourhood of 0. 


An alternative approach to ours would have been to use the normal form 
described in [9J. In fact, probably, the duality and the existence of a normal 
form in the sense of f[9j] imply each other. However we obtain our result 
via a different method. 

We now map each vector of operators 6 G to a stochastic game Go- 
First we place one vertex in G 6 per component of 6, i.e. formally we 
fix V(Gq) = (vi .. .v n }. Then we stipulate that vt is of type max, min. 
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or s according to whether ot is a max, min, or weighted average operator 
respectively. Finally, for each i, let 

ol: (xi ...x n ) i-a □i(x i i + k) ...xp + kW) 

where Dt can be either of 


D u (yi ^ 


( max(y 1 ...y m i) 
J min(y, ...y m 0 

rv\ -I-. _U . 


then we introduce an edge (v-t,Vp) G E(Ga) for each pair of i G {1 .. .n} 
and l G {1 ... mi} with payoff 


po(vi,Vji) = k\ 

and, if Dt is a weighted average, with probability 


pr(v t , Vji) 


a 


i 

l 


0 i\ + 


+ a 1 i 

m l 


Lemma 4.3. Let o G be a vector of operators, and let Vi denote the value 
vector of the game Go with the limiting average payoff. The problem P(o) 
is satisfiable if and only if Vi (vt) >0 for all vertices V| of G e - 


Proof (if direction). Using Lact |4.2[ [3|, let 

OO 

up = at( 1 - (3) 1 

i=0 


be the value vector of Go with discount ( 3 . It follows from Lact 4.2||2] l that 
(ao)j = Vi (vj) >0 for all j G {1 ... n}. Lor N denoting a (large) real number, 
define x^ G R n by 

(x N )j = N(a 0 )j + (ai)j 


We claim that, for large enough N, the vector xn satisfies P(o). 

Let us consider the limit discount equation for max-, min-, and s- 
vertices separately. We will show that the condition on each vertex Vj 
implies that the corresponding coordinate (xj\|)j satisfies P(o). 

If vj is of type max, then 


OO OO 

Y_ (hi)j(l - ( 3) 1 =* max ((1 - | 3 ) pofvj^) + |3 - ( 3 ) 1 ) 

~— n l | (v^vJeEtGo) ~— 


Since series are ordered lexicographically, truncating both sides to the first 
two terms commutes with the max operation 


(a 0 )j + (ai)j(l - (3) = 

max (fl-oh + (po(vj,vi.) — (ao)i, + (ai )U (1 -(3) 
>• I (vj,v l )€E(G e ) V ' 
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From which it follows that 


(a 0 )j = max (ci 0 )i 
tl (vj,vi)eE(G a ) 

[ai )j = max 

1 realizing the max above 

< max 

1 realizing the max above 


potv^vO - (a 0 h + (aih 
potv^vO + (ath 


Hence, for large values of N 


N(a 0 )j + (a^j < max N(a 0 )i + po(v j ,v l ) + (at h 

l I (VjAjeEtGo) 

Vertices of type min are treated precisely as those of type max. Finally, 
for stochastic vertices, we get 


(a 0 )j + (cii)j(l - ( 3 ) = 

Y_ (ao)i + (po(vj,v l )-(a 0 ) l + (a 1 )i)(l -( 3 ) 

1 I (vj,v 06 E(G 0 ) 

whence, multiplying by (1 — ( 3 ) 1 and evaluating at 1 — (3 = 1 /IN 

N(a 0 )j + (ai)j = Y_ N(a 0 )i + po(vj,v l )-(a 0 )i. + (ai)i 

l I (vj,vi)eE(G 6 ) 

< Y_ M(a 0 )i + po(vj,vi) + (aO; 

l I (vj.vrleEfGs) 

□ 


Proof (only if direction). Fix a solution x. of P(o). We claim that the following 
strategy 7t MAX for max (which, incidentally, is stationary and pure) satisfies 
Vi (vi, 7T max , •) > 0 for all vertices vt of Go- Let vt be a MAx-vertex, assume 
that it is max's turn and the token rests on v t , we will say which of the 
out-edges of vt the player max will elect to move the token along. Let us 
consider the operator oi, which necessarily has the following form 


Oil (xi .. .x n ) H-t max(x i t + k) ...xp + khp) 


The player max then moves the token to a vertex vp such that Xj L + k[ 
realizes the maximum (which one he chooses is immaterial). 

Now we intend to prove that Vi (v-l, 7t MAX , •) > 0 . To this aim, because of 
Fact 1, it is enough to test our strategy 7t MAX against all stationary and 
pure strategies for min. Let 7t MIN be such a strategy. A play generated 
by the pair of strategies (7t MAX , 7T min ) is a Markov chain on the finite state- 
space {vi ... v n ). The average time spent by the process in each state during 
plays starting at Vt must converge to a stable distribution p. The limiting 
average payoff Vi (vp 7 t MAX , 7 t MIN ) can be described using p by 


Y h(v a )pr / (v Q ,v b )po(v Q ,v b ) 

a,b | (v a/ v b )eE(G fl ) 


V! (Vi, T^max/ TImin) 
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where 


pr'(v a ,v b ) 


prfv u , v h ) if v Q is a stochastic vertex 

1 if v Q is a m Ax-vertex and 7 r MAX (- • • -a v q ) = v b 

1 if v Q is a MiN-vertex and 7t MIN (- • • -a v a ) = v b 

0 otherwise 

V 


We need to prove that the above quantity is strictly positive. 
For all a G {1 ... n} we have 


x a < Y pr'(v Q/ v b )(x b +po(v Q/ v b )) 

b I (v a ,v b )eE(G a ) 


which, for min- and s-vertices, is an immediate consequence of x being a 
solution to P(o), and, when v Q is a MAX-vertex, it follows for our choice of 
the strategy 7t MAX . Splitting the sum on the right hand side 

*q- Y pr'(v a ,v b )x b < pr'(v a/ Vb)po(v Q ,v b ) 

b I (v a ,v b )eE(Go) b I (v a ,v b )eE(Go) 


Then multiplying by |i(v a ) and taking the sum over a 


n 

Y h( v a)x Q - Y. q(v a )pr'(v a/ Vb)x b 

a=1 a,b | (v a ,v b )eE(Go) 

< Y_ h(v a )pr'(v a ,Vb)po(v a ,v b ) 

a,b | (v a ,v b )eE(G s ) 


We need to prove that the left hand side is not negative. By p being a stable 
distribution, we have 

M-(vb) = Y POa)pr'(v Q ,Vb) 

a I (v a/ v b )eE(G a ) 


hence 

n 

I^a)V Y h(Va)pr'(v a/ Vb)x b 

a=1 a,b | (v a ,Vb)GE(G q) 

n n 

= Y p( v q)Xq ~Y ( Y p(Va)pr'(v Q ,Vb))x b 

a=l b=1 a | (v a ,v b )eE(G fi ) 

n n 

= Y h( V a)Xa - Y h( V b)Xb = 0 

a=l b=l 


□ 


Lemma 4.4. Let 0 G be a vector of operators, and let Vi denote the value 
vector of the game G ( -, with the limiting average payoff. The problem D(o) 
is satisfiable if and only if vi (vt) ^ 0 for some vertex v b of Go- 


The proof of this lemma is similar to the proof of Lemma 4.3 above, we 
will therefore only point out the relevant differences. 
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Proof (if direction). As in the proof of Lemma 4.3 using Fact |4-2[[3|) x let 


vp = cu(1 - (3) 1 


i=0 


be the value vector of Go with discount ( 3 . Let v^ m ^ 0 denote the min¬ 
imum of Vi (vj) = (ao)j over all vertices Vj. We define y G (RU{+oo}) n 
satisfying D(o) by 


Vi = 


(ai)j if (a 0 )j = V," 
+00 otherwise 


We want to show that the condition imposed by the limit discount 
equation on each vertex Vj implies that the corresponding coordinate Q j 
satisfies D(o). As opposed to Lemma [4/3] we can concentrate on those 
vertices that have minimal value, i.e. (ao)j = v™ m , because those with larger 
value give rise to +00 coordinates for which D(o) is automatically satisfied. 
If Vj is of type min, then, considering the limit discount equation and 
truncating the series to the first two terms, we have 

v^ + (a 1 )j(l-( 3 ) = 

min (a 0 )i + (po(vj,v l )-(a 0 )i + (ai)i)(l -( 3 ) 

1- I (v,,v06E(G 0 ) 

The min can be restricted to those values of l for which (fio)i = v'[' in 
vf n + (a 1 )j(l-( 3 ) = 

vr+(po(Vj,v l )-v i r + (a 1 )i)(l-( 3 ) 

Subtracting v™ m from both sides and multiplying by (1 — | 3 )~ 1 

yj=(&i)j= min po(vj,v v ) -v™ n +(ut)!. 

l| (vj,v l )£E(Go)A(a 0 )i=vy m 

^ min po(Vj,vi) + (ai); 

l | (vj,vi)GE(Go)A(ao) l =v 1 j™ 1 

= min po(vj,vi)+yi 

1 I (vj,vd€E(G 0 r 

For Vj of type max we obtain as before 
vf n + (a 1 )jO-[3) = 

max (a 0 )i + (po(vj,v l )-(a 0 )i + (ai)i)(l -( 3 ) 

1 I (vj/vdeEfGo) 

hence 


mm 

l I (vj,v : )eE(Go)A(a 0 )i=vf" 


-.min _ 

Vi — 


max (a 0 )i 

1- I (vj,v v )eE(Go) 


and, by the minimality of v" 1 " 1 , we have that (ao)i = v'," 111 for all l such that 
(vj,v;) gE(G 0 ). Therefore 

v™™ + (di )j (1 — ( 3 ) = 

max vf un +(po(vj,v l )-(a 0 )i + (ai)i)(l -( 3 ) 

1 I (vj,vi)eE(Go) 
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and we conclude again subtracting v'|" n and multiplying by (1 — ( 3 ) 1 . 
Finally stochastic vertices are dealt with as m Ax-vertices observing that 

v mm = pr(Vj,vO(a 0 )l 

l | (Vj,v l )cE(Go) 

implies, again by the minimality of v™ m , that (flo)i = v™ m for all l such 
that (Vj,v 0 G E(Go). □ 

Proof (only if direction) . Fix a solution y G (]RU{+oo}) tl \{+oo} n of D(o). 
We produce a strategy 7t MIN for min that satisfies Vi (vi,7t MAX , ■) ^ 0 for 
some Vi.: specifically Vi (vi,7t MAX , •) ^ 0 if yt is finite. Assume that it is 
min's turn and the token rests on v b . If ip = +oo, then it is immaterial 
which move min chooses. Otherwise, let us consider the operator 

Oil (Xi .. ,x n ) 1-t min(x j i +k, .. .xp + kW) 

The player min moves to a vertex vp such that xp + k{ realizes the min. 

As in the proof of Lemma [4.3} pick a stationary pure strategy 7t MAX 
for max, and consider the Markov process defined by 7t MIN and 7t MAX 
starting from vertex vt. If yt is finite, then it is easy to see that, by our 
choice of 7 t MIN , no vertex Vj with ip = +00 can be reached by a play starting 
from v^. Let p be the stable distribution to which the Markov chain started 
from vt converges. The limiting average payoff is 

Vi (Vi,7T MAX ,7t MIN ) = Y_ M-(Va)pr'(v Q ,V b )po(v Q ,V b ) 

a,b | (v a ,v b )eE(G a ) 


where 


pr (v Q ,v b J = < 


pr(v Q ,v b ) if v Q is a stochastic vertex 
1 if v a is a m Ax-vertex and 7t MAX ( 

1 if v Q is a MiN-vertex and 7t MIN ( 

0 otherwise 


For a G {1 ... n} such that y Q is finite, we have 

y Q ^ Y. P r ' (v ar Vb)(yb +po(v Q ,v b )) 

b I (VaVb)eE(Go) 


tV Q )—v b 
V a ) = v b 


and proceeding as in the proof of Lemma 4.4 


Y_ M-( v a)ya- Y M-(va)pr'(v a ,v b )y b 

<i|ya^+oo a,b | (v a ,Vb)CE(Go)Ay a p:+oo 

^ Y p(v a )pr'(v a ,v b )po(v a ,v b ) 

a,b | (v a ,v b )eE(Go)Ay a p;+(X) 

where the sums can be restricted to y a f +00 because the vertices v a with 
y a = +00 are unreachable. We can conclude using the fact that 4 is a stable 
distribution. □ 


Theorem 4.1 follows immediately from Lemma [4T3] and Lemma 4.4 







24 


M. BODIRSKY AND M. MAMINO 


5. Complexity of Tropically Convex CSPs 

In this section, we will apply our duality to tropically convex constraint 
satisfaction problems. By Theorem |3-4[ we know that the tropically convex 
relations are precisely those primitive positive definable in the structure 
ft = (Q;<,Ti,T_i,S 3 ,M 0 ) where 

T±i (x,y) <=> x ^ y ± 1 

S 3 (x,-y,z) <=> x ^ 

M 0 (x,-y,z) x ^ max(y,z) 

Max-atoms (with constants in binary) is polynomial-time reducible to the 
CSP of r t/ but CSP(F t ) is more expressive. We intend to prove the following 
theorem. 


Theorem 5.1. The problem CSP(Pt) is in NP n co-NP. 


Instead of the finite constraint language of ft, we could have chosen to 
work with basic tropically convex sets (in the sense of section [3]) encoded 
with the constants expressed in binary. In view of Observation \$. 6 \ this 
choice is immaterial. The reader can also check that the same proofs apply 
to both settings. Also, it is easy to extend F t with relations of the form x = c 
for rational constants c: the idea is to introduce a new variable z and replace 
x = c with x = c + z (which is primitive positive definable in Ft), then by 
translation invariance we have a solution if and only if we have a solution 
with z = 0 . We begin by proving an analogue of Theorem 4.1 for non-strict 
inequalities. 


Corollary 5.2. For any given vector of operators o E 0 [( we consider the 
following satisfiability problems: the primal P'(o) and the dual D'(o) 

y e (QU{+oo}) n \{+oo} n 
V > o(tj) 

where ^ and > are meant to hold component-wise, and we stipulate 
that +00 > +00. Then one and only one of the problems P'(o) and D'(o) 
is satisfiable. 


x E Q n 
x < o(x) 


Proof. We claim that the problem P'(o) is satisfiable if and only if the 
problem P e (o) defined as follows 

x E Q n 
x < o(x) + Te 

where T denotes the vector ( 1,1 ...) E Q n , is satisfiable for all e > 0 . The 
only-if direction is, in fact, immediate. For the if direction, by definable 
choice, we can choose a solution x(e) of the second problem which is a 
semilinear function of e. Hence the limit xo = lim e ^ 0 ■ x(e) exists and it is 
easy to check that xq satisfies of P'(o). 
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Applying Theorem 4.1 we get that P £ 
following problem, D e (o) 


(o) is satisfiable if and only if the 


V € (QU{+oo}) n \{+oor 
y ^ o(y) + Te 


is not satisfiable. In turn, it is immediate that D e (o) is satisfiable for 
some e > 0 if and only if D'(b) is satisfiable. □ 


Before proceeding to the proof of Theorem 5.1 we need one last technical 
statement. 


Definition 5.3. Consider a quantifier free semilinear formula (j)(t,x) with 
rational coefficients, where t denotes a variable and x denotes a tuple of 
variables. We say that c[)(t, x) is satisfiable in 0 + if 

3 to > 0 Vt G ] 0 , to] 3 x 4 >(t,x) 


Lemma 5.4. The problem, given cj) as in Definition 5.3 with coefficients 
encoded in binary, of deciding whether cf) is satisfiable in 0+ is in NP. 


Proof. Satisfiability for quantifier free semilinear formulas is in NP by 
standard linear programming techniques. In our case, consider the two- 
dimensional ordered vector space over Q 

V = {a + be | a,b G Q} 

where the expression a + be is just a formal replacement for (a, b), and the 
order is lexicographical - in other words, writing e for 0 + 1 e = (0,1), we 
have ( 0 , 0 ) < ( 0 , 1 ) <C ( 1 , 0 ) or 0 < e <C 1 . We claim that cf>(t, x) is satisfiable 
in 0 + if and only if 4 >(e,x) is satisfiable in V. Before proving the claim, we 
may observe that this is, indeed, sufficient to conclude. In fact 

3 x G V n <t>( e /*) 


is, by definition, equivalent to 

3 a, b G Q n 4 >(e, a + be) 

and the subformula <j)(e, a + be) can be easily replaced by a quantifier 
free semilinear formula over Q, by substituting each basic relation with its 
component-wise definition. 

It remains to prove the claim. At first, we can observe that a basic relation 
(say a + be < c + de) holds in V, if and only if the corresponding relation 
(a + bt < c + dt) holds for all t sufficiently small. The if part of the claim 
follows immediately: let x = a + be be a satisfying assignment for cf)(e, x) 
in V, then cj)(t, a + bt) must hold for all sufficiently small positive t G Q. 
For the only if part, if cf>(t, x) is satisfiable for all t G ] 0 , to], then, by the 
definability of Skolem functions, there is a semilinear function 

f: ]0,t o ] -a Q n 
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such that x = f(t) is a satisfying assignment for all t G ] 0 , to]- Now, for 
some positive ti < to, the restriction of f to ] 0 ,ti] must be linear. In other 
words, there are a and b in Q n such that 

Vt € ]0,ti] 4>(f, a + bt) 

hence x = a + be £ V must satisfy 4 >(e,x). □ 


Proof of Theorem [yTj For the NP part, it suffices to observe that after guess¬ 
ing which of the inputs of each max constraint realizes the maximum, one 
is left with a linear feasibility problem, which is in P. 

For the co-NP part, we will employ the following strategy First we 
replace each strict inequality A<Bby 3 e> 0 A^B — e. Flence we can 
apply Corollary \$.i\ so we get that our problem is not satisfiable if and only 
if for all e > 0 some D' (6 e ) is satisfiable. We then conclude by Lemma 5.4 


First let 4 ) denote an instance of CSP(F t ). Construct a new formula 4 ) e 
by formally replacing each strict inequality A < B in cf> by A ^ B — e, the 
new formula cf> e is hence a conjunction of non-strict inequalities. Clearly 
<|) is satisfiable if and only if there is an e > 0 such that 4>e is satisfiable. 
Now, the formula cj) e is almost in the form x A o e (x) that we need to apply 
Corollary I5.2} except that the same variable may appear in the left hand 
side of more that one constraint. To correct this discrepancy, let r t ' be the 
expansion of F t obtained by addition of relations of the form 


xq ^ minjxi .. ,x T 


We rewrite (|) e as a new formula <j)' in the language of F t ' by replacing each 
left hand side instance of a variable xt in cj) e with a new variable xtj, X42 • • • 
and then adding a constraint 

xt ^ min(xiq,x ij2 ...) 

for each of the old variables xt. The formula c[)'. is in the form x A o e (x), 
therefore, by Corollaryit is non-satisfiable if and only if y > o e (y) has 
a solution in Q U {+00} which is not +00 on every coordinate. Flence we 
have reduced the non-satisfiability of (|) to the following formula if> 

Ve > 0 3 y <G (QU{+oo}) n \{+oo} n y>o e (y) 

which we intend to prove that can be checked in NP. In fact, if an as¬ 
signment y = yo satisfies y > o e (y) for e = eo, then the same assignment 
must satisfy y > o e (y) also for any other e > eo- As a consequence ij> is 
equivalent to the following formula ' 

3 e 0 > 0 Ve G ] 0 , e 0 ] 3 y e (Q U{+oo}) n \{+oo} n y>o e (y) 

We can therefore apply Lemma I5.4I observing that the domain Q U {+00} 
can be coded in (Q;+, in a quantifier free fashion—for instance by 
pairs (a,b) £ Q 2 where (x, 1) represents the number x and (1,0) repre¬ 
sents +00. □ 
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6. A Polynomial-time Tractable Fragment 

We present an algorithm that tests satisfiability of a given (quantifier-free) 
restricted Horn formula cp. Let V be the set of variables of CD. Recall that 
each restricted Horn clause has at most one literal which contains a variable 
with a negative coefficient. We call this literal the positive literal of the clause, 
and all other literals the negative literals. 

Solve ((D) 

//Input: a restricted Horn formula <P 
Do 

Let ¥ be the clauses in cp that contain at most one literal. 

If ¥ is unsatisfiable then return unsatisfiable. 

For all negative literals cp in clauses from cp 
If d 7 A cp is unsatisfiable, then M 7 implies _, (p: 
remove cp from all clauses in CP. 

Loop until no literal has been removed 
Return satisfiable. 

For testing whether a set of linear inequalities is satisfiable, we use a 
polynomial-time algorithm for linear program feasibility, such a the ellip¬ 
soid method II26I ; it is well-known that this method can also be adapted to 
the situation where some of the inequalities are strict, see e.g. [23I. Since the 
algorithm always removes false literals, it is clear that if the algorithm re¬ 
turns unsatisfiable , then cp is indeed unsatisfiable. Suppose now that we are 
in the final step of the algorithm and the procedure returns satisfiable. Then 
for each negative literal cp of CP the set T A cp has a solution : V —> Q. Let 
s be the mapping s(x) = max (p neg ative literal of ® s cp M- Clearly, s satisfies W 
since the mappings s (p satisfy M 7 , and since all literals in ¥ are max-closed. 

We claim that s satisfies all negative literals cp = (a-|Xi H-a n x n >- c) in 

cp, too: 

c -< ais<p(x-|)-|- b Q-nScp (x n ) since Scp satisfies cp 

^ ai s(xi) H- b a TX s(x n ) since ai,..., a n are positive. 

Since every clause of cp either contains a negative literal or it is contained 
in T, this shows that s satisfies all constraints in (P. 

7. Maximality of Max-closed Semilinear Relations 

Proposition 7.1. Let R C Q n an n-ary relation that is not max-closed. Then 
CSP(r 0 ,R) is NP-hard. 

Proof. The proposition follows easily from fl2il Theorems 6.5-6.6], as it is 
very short we offer here a direct argument. 

Let s, t e R be such that m = maxi's, t) f R. Clearly the finite relation 
S = {s, t, m} is max-closed and semilinear, hence R Pi S = (s, t} is primitive 
positive definable in (Q; To, R). Now, consider the 3 n-ary relation 

T(x,y,z) x, y, z G R n S A max(x, y, z) = m 
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which is also primitive positive definable in (Q; To, R). Clearly 
T = (RnS) 3 \{(s,s,s),(t,t,t)} 

and this gives a direct reduction of the NP-complete problem of positive 
not-all-equal 3 SAT fi6l 

CSP ({0,1};{0, l} 3 \{(0,0,0), (1,1,1)}) 

toCSP(r 0/ R). □ 
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